Teaching Your Models To Play Fair